Mobile Phone Operations using Human Eyes Only and Its Applications

Mobile phone operations using human eyes only is proposed together with its applications for cooking with referring to recipes and manufacturing with referring to manuals, production procedure, so on. It is found that most of mobile phone operations can be done without touching the screen of the mobile phone. Also, mobile phone operation success rate based on the proposed method is evaluated for the environmental illumination conditions, visible or near infrared (NIR) cameras, the distance between user and mobile phone, as well as pupil size detection accuracy against the environmental illumination changes. Meanwhile, the functionality of two typical applications of the proposed method is confirmed successfully. Keywords—Mobile phone operations; line of sight estimation; gaze estimation; wearable computing; pupil detection